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TITLE OF THE INVENTION 

VOICE CCiMMUNICATIOM DEVICE AND ECHO PROCESSING PROCESSOR 

5 

TECHNICMi FIELD 

The present invention relates generally to a voice cannrainication 
device such as an on-vehicle telephone or a portable visual telephone^ 
and more particularly to an echo processing device and an echo 
1 0 processing processor in which an echo include in a transmitting speech 
signal due to the ndxing of output voice output from a speaker with 
input voice input through a microphone is reduced. 

BACKGROUND BRT 

1 5 Fig • 15 is a block diagram showing the configuration of a conventional 
voice communication device, and Fig, 16 is a block diagram showing 
an echo proce36ing unit arranged in the conventional voice 
corTHmmication device showx in Fig, 15 and peripheral unitti. Tn Fig. 
15, 1 indicates a conventional voice coaiununication device* 2 indicates 

2 0 a volume control unit, 3 indicates a receiving circuit unit. 4 

indicates alMse band signal processing unit* 5 indicates a voice codec 
(coder-decoder) . 6 indicates an ^cho processing unit. 7 indicates a 
D/A converter. 8 indicates a speaJcer amplifier. 9 indicates a control 
CPU* 10 indicates a speaker. 11 indicates a microphone, 12 indicates 

2 5 a micrqphone amplifier. 13 indicates an A/ D converter • 14 indicates 

a transmitting circuit unit. Next/ the configuration and operation 
of the conventional voice communication device will be described with 
reference to Fig. 15, 
A near-end caller using the conventional voice coinraunication device 

3 0 1 / or a terminal user^ adjusts the volume on the speaker 10 (hereinafter. 
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called speaker voluffue) by using the volwiti control ujait 2 . An e:Ktenaal 
received signal K, which is traiusmitted frcm a far-end caller^ or a 
person on the other end of the line^ and ie received in the conventional 
volcft commuTLication device 1^ is converted into a digital signal of 
5 an intermediate freqiienciy band in the receiving circuit unit 3 and 
is demodulated in the base band signal pracejsaing unit 4, and the voice 
decoding process is perf omned for the esstemal received signal R in 
the voice codec 5 to obtain a received input signal Rd (i) . Thereaf ter, 
the received input signal Rd {i ) is output to the D/A converter 7 through 
.^^^ 10 the echo processing unit 6- 

JiJ In the WA converter 7, the received input signal Rd(i) is converted 

ij] into an analog signal Ka and is output to the speaker an^lifier 8, 

V: for example, forxofed of an operation ajraplifier, Also^ a spealcer 

an^lification value corxesponding to the speaker volume, which is 
3 15 adjusted by the terminal user by using the volume control unit 2, is 
'^j-J output to the speaker amplifier 8 through the control CPU 9. In the 

3peaker ainplirier 8, the analog signal Ra is ait^llfied according to 
1-3 t±ie speaker amplification value output from the control CPU 9, and 

the amplified analog signal Ra is output to the speaker 10 a3 a received 
2 0 output signal. Thereafter, output voice is output frocu the speaker 

10 to the outside at the speaker volume desired by the terminal user* 
Also, input voice given by the terminal user is input to the 

conventional voice coinmunicatlon device 1 through the micrcphone 11. 

Alsor the output voice output from the weaker 10 is input to the 
2 5 microphone 11 as an echo in addition to the input voice of the terminal 

user while the output voice is deformed according to an acoustic 

transmission characteristic of a path between the speaker 10 and the 

laicrophone XX. The path^ through which the output voice output frciti 

the speaker 10 is input to the microphone 11/ is called an echo path- 
30 A transndtting input signal $a including the echo is input to the 
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converter 13 ttirough the microphone anplif ier 12 as an analog signal 
Sa/ Is converted into a signal Sd(i) in the iV/D converter 13 and is 
output to the 6Ctho processing unit 6. 
The configuration of the echo processing unit 6 is shown in Fig* 
5 16, In Fig* 16, 15 indicates an echo canceller . 16 indicates an adaptive 
filter. 17 indicates a subtracting unit. 18 indicates an echo 
suppressor. The received input signal Rd{i) input from the voice codec 
5 to ths echo processing unit 6 are transmitted to both the echo 
canceller 15 and the echo aiipfpressor 18. Also, tha received input 
10 signal Rd(i) is transmitted through the echo processing unit 6 and 
is output to the D/A converter 7. In the echo canceller 15, a pseudo 
echo SE(i) similar to the echo included in the signal Sd(i) is 
synthesized, and a residual signal U(i) not including the echo is 
obtained by subtracting the pseudo echo SE (i) frcxn the signal Sd(i) . 
- 15 The residual signal U(i) is input to the adaptive filter 16. 
^i^ tn the ad^tive filter 16^ the acoustic transmission characteristic 

'^jr of the echo path between the speaker 10 and the micrcphpjie 11 i3 

estimated by using both the received input signal Rd(i) output from 
the voice codec 5 and the echo-removed residual signal U(i) r filter 
20 coefficients h (nj are calculated each time the acoustic transmission 
characteristic is estijoated, the pseudo echo 5E(i) is produced from 
both ttie received input signal Rd{i) and the filter coefficients h (n) , 
and the pseudo echo SE (i) is output to the subtracting unit 17 . In 
the subtracting unit 17^ the signal Sd(i) output from the A/D converter 

2 5 13 is received, the pseudo echo SE(i) is subtracted from the signal 

Sd(i), and the echo-removed residual signal U(i) is output. 

The echo-removed residual signal U(i) is output from the echo 
canceller 15 to the echo suppressor 18 * An operation performed in the 
echo suppressor 18 differs from, that performed in the echo canceller 

3 0 15, and an airgplitude of a signal output from the echo canceller 15 
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is uniformly suppressed In the echo suppressor 18, In detail^ in tlae 
echo suppressor 18, a. short-time power of the received input signal 
Rd(i) is calculated, it is judged that a time period/ in vjhich a value 
of the sHort-tiine power is equal to or higher than a threshold value, 
5 denotes a voice uttering time period of the far-end caller, the 
ainplitude of the residual signal U (i) received from the echo canceller 
15 is suppressed during the voice uttering time period by a 
predetenninBd attenuation degree (for exaitrple^ 10 dB) not so high, 
and a transmitting output signal Td(i) is obtained. Theireafter, the 

10 voice coding is performed in the voice codec 5 for the transmitting 
output signal Td(i) of which the aitjjlitude is suppressed by the 
predetermined attenuation degree in the echo suppressor 18. 
Thereafter, the transmitting output signal Td(i) is modulated in the 
base hand signal processing unit 4, is converted into an analog signal 

15 of a trajmswission frequency band in the transmitting circuit unit 14 
and is transmitted as an external transmitting signal T. 

As is described above, in the echo processing unit 6 of the 
conventional voice comiminication device 1, a residual echo coraponent 
not sufficiently removed in the echo canceller 15 is suppressed in 

20 the echo suppressor 18. Also, because the attenuation degree is set 
to a Value not SO liigh, the voice of the near-end caller is prevented 
from being considerably attenuated during a double-talk time period 
in which the far-end caller and the near-end callex- siimiltaneously 
give voices* 

25 Also, in Fig. 2 of Published Unexamined Japanese Patent implication 
HlO-242891 of 1998, another echo canceller is disclosed. In this echo 
canceller, a conventional double talk detection is performed, and the 
renewal of filter coefficients is stopped or started according to the 
detection, in Fig. 2 of the Published Onexaitdned Japanese Patent 

30 ixpplication HlO-242891 of 1998, a power of a transmitting signal 
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transmitted from the side of a near-end caller is expressed by Sp, 
a power- of a received signal sent from, the oide of a far*-end caller 
is expressed by Rpr Siiid a power of a residual signal denoting en output 
signal output frcm a si±>tracting circuit 21 is expressed by Ep. In 
5 this conventional echo canceller, following eqaations (1) to (3) are 
used, when one of following conditions is satisfied, it is judged that 
a current tljne is in a double-tallc titae period (or a tlmo period in 
which the near-end caller and the far-end caller sljnult^eously gives 
-voices) or a voiceless time period of the far-end caller ^ and the 
10 renewal of filter coefficients is stopped* Here, PI/ P2 and P3 are 
ecjual to fixed values respectively. 

Rp < PI U> 
Sp < P2 X Tip (2) 
Ep < F3 X Sp (3) 
15 Condition-1: equation (1) is gatisfied. 

Condition^2: equation (1) is not satisfied, but equation (2) is 
satisfied* 

Condition-3: neither equation (1) nor equation (2) is satisfied, but 
equation (3) is satisfied. 

2 0/ Also, anotlter conventional invention is disclosed in Published 

Unexamined Japanese Patent J^lication HI 0-294785 of 1998. In this 
conventionsLl invention, a speaker anriplif ication value output from 
an external input is received in a control CPU, the spea35:er 
aiqjlif ication value is output from the control CPU to a speaker 

25 ainplif ying unit, a full-wave rectification is performed for an output 
of the speaker an^ilif ying unit in a full wave rectifier, and a full-wave 
rectified signal is input to the control CPU. Thereafter, a gain of 
a received signal input to an echo canceling circuit is controlled 
according to the full-wave rectified signal. That is to say, a speaker 

30 output is calculated from the full^wave rectified signal transraitted 
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tlirough the full wave rectifier, and a gain of a received signal input 
to an echo canceller circuit is enlarged according to the speaker 
output- Therefore, the received signal detenftined according to the 
speaker output cexx be input to the echo canceling circuity and the 
5 echo cancellation can be effectively performed. 

However^ in the conventional echo processing \mit 6 shown In Fig. 
16, in cases where the speaker arapiification value is set to a value 
higher than a certain value, non- linear distortion occurs in a signal 
output froia an operation amplifier of the speaker amplifier 8. Also, 
10 ±n cases where the speaker ainplification value is set to a high value, 
a loud voice is output from the speaker 10, and an amplitude of the 
analog signal Sa input to the Ti/U converter 13 through the microphone 
11 and the microphone afmpllfier 12 is enlarged. In cases Where the 
aix^litude of the analog signal Sa is set to a value hi^er than a certain 
15 value so as to exceed an input maxdLttium value of the A/D converter 13, 
non-linear distortion occurs in the output of the A/D converter 13. 

In this case, non-linear distortion occurs in the signal Sd(i) input 
to the echo canceller 15 due to both or one of the non-linear distortion 
occurring in the signal of the speaker amplifier 8 and the non- linear 
20 distortion occurring in the output of the A/D converter 13 . An example 
of the signal Sd(i) having no non-linear distortion is shown in Fig* 
17 (a) / and an exair$>le of the signal Sd(i) having non-linear distortion 
is shovffi in Fig. 17 (b) » As a result of the occurring of the non-linear 
distortion in the signal Sd<i) the precision in the estiination of 
25 the filter coefficients h(n) performed in the adaptive filter 16 is 
degraded- Therefore, the difference between the pseudo echo SE(i) 
calculated from the filter coefficients h(n) and an echo actually 
included in the signal Sd(i) is enlarged, and an echo removing 
performance of the echo processing unit 6 is degraded- Also, in 
30 addition to the degradation of the echo removing performance/ there 
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probability that a signal equivalent to a degraded sound is added 
to the signal Sd(i) • when the echo renioving performance is degraded, 
a large residual echo remains in the residual signal U(i) output from, 
the echo canceller iS. In this case, even though the echo suppressing 
5 process is performed for the residual signal U(i) in the echo 

si^ressor IS so as to suppress the ainplitude of the residual signal 
U(i} by a prescribed attenuation value, a problem has arisen that a 
large echo coit^netit remains in the transanitting output signal Td{i) . 
AIsOf in the conventional invention disclosed in the Pliblished 

10 Unexamined Japanese Patent Application Hi 0-2 42891 of 1998, when the 
speaker amplification value is changed, there is probability that the 
power Ep of the residual signal is heightened due to the degradation 
of the echo removing performance- In this case, the equation (3) is 
satisfied, and It is erroneously judged to be the double talJc. 

15 Therefore, because the renewal of the filter coefficients is stopped, 
the echo removing per forttiance is not improved, and a problem has arisen 
that an echo remains in a transmitting output signal. 

Also, in the conventional invention disclosed in the Published 
Unexamined Japanese Patent Application Hl0-2^47fi5 of 1998, to 

20 determine the speaker amplification value of the speaker airplifier, 
it is required to arrange the full wave rectifier. Therefore, a problem 
has arisen that a size of the echo processing device is enlarged- Also, 
because a waveform of the signal output from the full wave rectifier 
is considerably changed, it is difficult to accurately determine the 

25 speaker amplification value* 



DISCIiOSURE or THE INVENTION 

The present invention is provided to solve the above-described 
problems, and a first object of the present invention is to provide 
30 a voice coiriniunication device having an echo processing unit in which 
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& r-esidual of an echo is si^>pressed regardleiss of a speaker 
ainplifiGation value. 

Also, a second object of the present Invention is to provide a voice 
commuj^ication device having a compact echo processing vmit* 
5 A voice coirarannication device of tiie present invention coir^rises a 
control CPU for outputting a apeiaker amplification value 
corresponding to voliime on a speaker which is adjusted by a terminal 
user by using a volunie control unit^ and an echo processing i^nit for 
reducing an echo equivalent to output voice, which is obtained by 

10 an?>lifying a received input signal demodulated and voice-decoded 
according to the speaker amplification value output from the control 
CPU and outputting the received input signal from the speaker and is 
mixed with a transmittijcig input signal input through a microphone, 
according to the speaker amplification value. 

15 The echo processing unit corttprises echo canceling means for 

calculating a pseiido echo ftcwiboth the received input signal amplified 
according to a degree of the change of the speaker ainplif icza.fcion v^lue 
and a filter coefficient calculated according to an acoustic 
transmission characteristic between the microphone zind the speaker, 

20 and removing the echo from the transmitting input signal including 
the echo by using the pseudo echo. 

The echo processing unit comprises echo canceling means for changing 
a filter coefficient/ which is calculated according to an acoustic 
transmission characteristic between the iQicrophop.e and the speaker, 

2 5 according to a degree of the change of the speaker anplif ication valuer 

calculating a pseudo echo from both the received input signal and the 
filter coefficient, azid reifiovijdg the echo from the transmitting input 
signal including the echo by using the pseudo echo* 

The filter coefficient is changed stage by stage by the echo canceling 

3 0 means in a case where the degree of the change of the speaker 
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amplification valuG is larger than a presc;ribed degree of the change. 

The filter coefficient is set to zoro or a value near to zero by 
the echo cancaling means in a case where the degree of the change of 
the speaker ajDaplification value is larger than a prescribed degree 
5 of the change - 

The filter coefficient is changed by the echo canceling means in 
a case where the degree of the change of the speaker an^plification 
value is larger than a prescribed degree of the change within a 
prescribed time period. 
10 The echo process iag unit camprise^ echo canceling means for 

calculating apseudo echo fracabotl^ the received ir^gput signal aod the 
filter coefficient calculated according to an acoustic transmission 
characteristic between the microphone and the speaker, changing the 
pseudo echo according to the speaker anplif ication value, and removing 
a 5 the echo from the transmitting input signal including the echo by using 
the changed pseudo echo. 

The pseudo echo liA set to zero or a value near to zero by the echo 
canceling means in a case whera the speaker amplification value is 
larger than a prescribed threshold value, 
2 0 The pseudo echo is attenuated by a prescribed value by the echo 
canceling means in a case where the speaker amplification value is 
larger than a prescribed threshold value. 

The pseudo echo, which is calculated according to the filter 
coefficient calculated before tlie speaker anopliflcat ion value becomes 
25 larger than a prescribed threshold value, is used by the echo canceling 
means to ranove the echo from the transmitting input signal in a case 
Where the speaker amplification value is larger than the prescribed 
threshold value. 

The echo processing unit comprises double talk detecting means for 
30 altering a judgment criterion for double talk detection according to 
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a degree of the ciiange of the speaker airqplif i cation value and detecting 
a double talk according to the altered judgment criterion, and echo 
canceling means for calculating a pseudo echo from a filter coefficient 
calculated according to an acoustic transmission Characteristic 
5 between the microphone and the speaker, reinaving the echo frora the 
transiaitting ir^ut signal including the echo by using the pseudo echo, 
and performing a renewal stop or a renewal start of the filter 
coefficient according to a detection result of the double talk 
detecting means • 

10 The echo processing unit corrprises doiiale talk detecting means for 

n altering a judgcaent criterion for doxible talk detection according to 

13 

Ij a degree of the change of the speaker amplification value and detecting 

a double talk according to the altered judgment criterion, echo 
;3 canceling means for reducing an echo conponent of the transmitting 

15 input signal by using a pseudo echo and producing a residual signal^ 
i^l and echo si;qppressing means for suppressing the residual signal 

produced by the echo canceling means at an attenuation value which 
i3 changes according to a detection result of the double talk detecting 

means. 

20 The double talk is detected by the double talk detecting means 

according to the comparison of a power of the trancsmitting input signal 
with a power of the residual signal/ and the judgment criterion for 
doiibl© talk detection Is altered by the double talk detecting means 
by changing a weighting factor, by which the power of the transmitting 
25 input sigxial is multiplied^ according to the degree of the change of 
the speaker aniplif ication value- 

Thd echo processing unit corcqprises echo suppressing means for 
3Uppres3ing tha transmitting input signal Including the echo at an 
attemiation value corresponding to tha speaker amplification value 
3 0 output from th& control CPCJ. 



Received at: 10:12PH, 9/13/2001 

20011 9^1 4B SHINSEI PATENT OFFICE 



NO. 6779 P. 12/92 



11 



The echo processing unit is formed of a digital eignal processor . 
An echo processing processor of the present invention comprines a 
received Signal input port for receiving a received input signal 
including voice infoxraation, a speaker anopliflcation value input port 
5 for receiving a speaker amplification value corj:espoxiding to volume 
vftiich is adjusted by using a voluaie control unit^ a transmitting signal 
Input port for receiving a transanitting input signal including voice 
given by a terminal user, and an echo reduction processing unit for 
performing an echo reduction process in which an echo equivalent to 
1 0 output voice , which is obtained by ampli f ying the received input signal 
received in the received signal input port according to the speaker 
|ij amplification value received in the speaker amplification value input 

port and outputting the received input signal from a speaker and is 
mixed with the transmitting input signal received in the transmitting 
15 signal input port. Is reduced according to the speaker anrpliflcation 
value. 

jjjx aij^jlifi cation process for att$>lif ying the received input signal 
received in the received signal input port according to a degree of 
the change of the speaker amplification value received in the speaker 
2 0 anqplification value input port, a filter coefficient calculating 
process for calculating the filter coefficient according to an 
acoustic transmission characteristic between a microphone and the 
speaker, a psevido echo calculating process for calculating a pseudo 
echo from the filter coefficient calculated in the filter coefficient 
25 calculating process and the received input signal amplified in the 
art^lif ication process and an echo canceling process for removing the 
echo f roiia the received ir^ut signal by using the pseudo echo are 
perfonned in the echo reduction processing unit- 
A filter coefficient calculating process for calculating the filter 
30 coefficient according to an acoustic transmission ciiaracteristic 
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between aniicrophone and the speaker, a pseudo echo calculating process 
for changing the filter coefficient calculated in the filter 
cxsef ficient calculating process according to a degree of the change 
of the speaker an^jlification value received In the speaker 
5 amplification value inpiit port and calculating a pseudo echo from both 
the filter coefficient and the received input signal received in the 
received signal input port and an echo canceling process for removing 
tha echo from the received ii^ut signal by using the pseudo echo are 
performed in the echo reduction processing unit. 
10 The filter coefficient is changed stage by stage in the pseudo echo 
calculating process performed in the echo reduction processing unit 
111 in a case where the degree of the change of the ^aker ainplification 

^■j value is larger than a prescribed degree of the change. 

|;3 Tha filter coefficient is set to zero or a value near to zero in 

15 the paeudo echo calculating process perfonrcd in the echo reduction 
jjl processing unit in a case where the degree of the change of the speaker 

"J^ amplification value is larger than a prescribed degree of the change- 

G The filter coefficient is changed in the pseudo echo calculating 

process performed in the echo reduction processing unit in a case where 
2 0 the degree of the change of the speaker amplification value is larger 
than a prescribed degree of the change within a prescribed time period* 
A filter coefficient calculating process for calculating the filter 
coefficient according to an acoustic transmission characteristic 
between a micixaphone and the speaker, a pseudo echo calculating process 
25 for calculating a pseudo echo from both the filter coefficient 

calculated in the filter coefficient calculating process and the 
received input signal received in the received signal input port and 
an echo canceling process for changing the pseudo echo calculated in 
the pseudo echo calcxilating process according to the speaker 
30 anplification value received in the speaker eanplif ication value input 
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port and rCTiovjjmg the echo from the received ir^ut signal by using 
the changed psGudo echo are perfonned in the echo reduction procctssing 
wxit ♦ 

The pseudo echo is calculated according to the filter coefficient^ 
5 TrAiich is calculated before the speaker axnplif ication value beccnaes 
larger than a prescribed threshold value, in the pseudo echo 
calculating process performed in the echo reduction processing unit 
in a case Where the speaker amplification value is larger than the 
prescribed threshold value, 

10 A double talk detecting process for altering a judgment criterion 
for double talk detection according to a degree of the change of the 
speaker an^lif ication value and detecting a double talk according to 
the altered judgment criterion, a filter coefficient calculating 
process for calculating the filter coefficient according to an 

15 acoustic transttdsslon characteristic between a microphone and the 
speaker and performing a renewal stop or a renewal start ot the filter 
coefficient according to a double talk judgment result of the double 
talk detecting process, a pseudo echo calculating process for 
calculating a pseudo echo f rem both the filter coefficient calculated 

20 in the filter coefficient calculating process and the received input 
signal received in the received signal input port and an echo canceling 
process for removing the echo from, the received input signal by using 
the pseudo echo are performed in the echo reduction processing unit. 
A double talk detecting process for altering a judgment criterion 

2 5 for double talk detection according to a degree of the change of the 

speaker amplification value and detecting a double talk according to 
the altered judgwe^cit criterion, an echo canceling process for reducing 
an echo corrponent of the transmitting input signal by using a pseudo 
echo and producing a residual signal and an echo suppressing process 

3 0 for suppressing the residual signal at an attenuation value vAiich 
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changes according to a detection result of the dxmble talk detecting 
process are perfprmi^d in the echo reduction processing unit. 

An echo suppressing procesB for suppre33ing the transmitting ir^ut 
signal including the echo at an attenuation value corresponding to 
5 the weaker aii5>lification value is performed in the echo reduction 
processing unit. 
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BRIEF DESCRIPTION OF THE HRAIrtllNGS 

Fig- 1 is a block diagram showing the configuration of a voice 
10 coinniunlcatlon device according to the present invention. 

Fig. 2 Is a block diagram showing the configuration of an echo 
processing unit arranged in the voice coocKiunication device according 
to a firgt etobodtpient of the present invention . 

Fig* 3 is a flow chart describing an operation of an ^dh.a canceller 
15 according to the first emfoodiroent of tlie present Invention. 

Fig- 4 is a flow chart describing an operation of an echo suppressor 
according to the first embodiiaent of the present invention. 

Fig- 5 Is a flow chart describing another example of the operation 
of the echo canceller according to the first embodlicient of the present 
20 wvention. 

Fig , 6 is a flow chart describing an operation of an echo canceller 
according to a second eoobodiiuent of the present Invention. 

Fig. 7 is a flow chart describing another exairjple of the operation 
of the echo canceller according to the second embodiment of the present 
2 5 ixLVentlon. 

Fig. 8 is a flovj chart describing an operation of an echo canceller 
according to a third embodiment of the present invention. 

Fig. 9 is a flow chart describing another exanple of the operation 
of the edho canceller according to the third embodiment of the present 
30 invention. 
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Fig. 10 is a flow chart describing an operation of an echo canceller 
according to a foxirt±k embodiment of the present invention. 

Fig* 11 is a flow chart describdLng an operation of an echo canceller 
according to a fifth embodiment of tlie present invention, 
5 Fig. 12 is a block diagram showing the configuration of an echo 
processing unit arranged in the voice communication device according 
to a seventh ertibodiment of the present invention. 

Fig, 13 is a flow chart describing an operation of an echo canceller 
according to the seventh embodiment of the present invention. 
10 Fig- 14 is a block diagram showing the configuration of an echo 
^ processing unit arranged in the voice commanication device according 

to an eighth embodiment of the precent invention. 

Fig. 15 is a block diagram showing the configuration of a conventional 
voice conraiunication device. 
15 Fig. 16 is a block diagram showing the configuration of an echo 
processing unit arranged in the conventional voice camnianl cation 
device* 

Fig. 17 is an explanatory view showing both a signal having no 
non-linear distortion and a signal having non-linear distortion, 

20 

BEST MODE TOR CARRYING OUT THE INVENTICOSr 

Hereinafter, the best mode for carrying out the present invention 
will now be described with reference to the accompanying drawings to 
explain the present invention in loore detail* 
25 EMBODIMENT 1 

Fig. 1 is a block diagram showing the configuration of a voice 
communication device according to the present invention, and Fig. 2 
is a block diagram showing an echo proce^^ing unit arranged in the 
voice coiraounication device shown in Fig. 1 and the configuration of 
30 peripheral units . In the conventional voice cotmmmication device^ the 
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control CFU 9 is arraagecJ to output the speaker ampXif icatloix value 
corresponding to the speaker volume adjusted in the volume control 
unit 2 to the speaker amplifier 0 . In contrast, in a voice corantuni cation 
device shown in Fig. 1, a control CPU 9 is arranged to output a ap^ak^r 
5 an^jlif ication Value S to both an echo processing unit 6 and a speaker 
amplifier The voice cornraunication device according to a first 
embodiment of the present invention coiii>ri3e3 an echo processing unit 
in which an echo included in a transmitting speech signal is reduced 
by controlling the echo canceller 15 and the echo suppressor 18 by 
10 usin^ the speaker artplif ication value S output from the control CPU 
9. Here, the constituent elements of Fig. 1 and Fig. 2, which are the 
same as or equivalent to those show in Fig, IS and t^ig. 16^ are 
indicated by the same reference numerals as those of the constituent 
elements shown in Fig. 15 and Fig. 16, and additional description of 
15 the same operations as those of the constituent eleanaents shown in Fig* 
15 and Fig, 16 is omitted- 

A tenainal user adjusts the volume on the speaker 10 (hereinafter, 
called speaker volume) by using the volume control unit 2, a speaker 
amplification value 5 corresponding to the adjusted speaker volume 

2 0 is output to both the echo processing unit 6 and the speaker aii$)lifier 

8 under control of the control CPU 9. The speaker amplification value 
S is set in the volume control unit 2 v^en the user operates a ke^^oard 
or a knob of the volume control unit 2. However, it is applicable 
that a mark corresponding to the speaker air¥>lif icatlon value S be input 
25 by using a keyboard and be received in the voli;ime control unit 2 to 
make the control CPU 9 output the speaker amplification value S 
corresponding to the mark through the volume control unit 2. 

In the speaker amplifier 8, as shown in Table 1, levels of seven 
anrplification values can be, for eixaraple, preset around a reference 

3 0 level at € dB intervals* 
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Table 1 
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10 



15 



20 
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24 


dB 
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18 


dB 




12 


dB 


+ 


6 


dB 




0 


dB (reference) 




6 


dB 




12 


dB 



which non-linear distortion occurs in the output of the speaker 
ar^plif ier 8, a^d a level of the speaker ai^lif ication value S, at which 
there is probability that a degraded somid is generated i^n the echo 
canceller 15, are measured and determined in ^*rance from the seven 
levels of the speaker ainplifier 8. Jn foUowiag description, non- 
linear distortion occurs in the output of speaker amplifier 8 when 
th6 ap«aker amplification value S is equal to or higher than 18 dB 
{or levfel A) , and thera is probability that a degraded sound is 
generated in the echo canceller 15 when the weaker amplification value 
S is equal to or higher than 24 dB (or level B) . 

The speaker an?)lification value S output from the control CPU 9 to 
the echo processing unit 6 is input to both the adaptive filter 16 
of the echo canceller 15 and tHe echo suppressor 18. In the echo 
canceller 15, the speaker amplification value S is used as a parameter 
applied to judge whether or not the echo removal should be performed 
for the signal Sd(i) . In detail, the speaker anpUfication value S 
input trcm the control CPU 9 is compared with a prescribed threshold 
valua, and it is judged whether or not the speaker aniplif ication value 
S is lower than 24 dB Cor level B) . In cases where the speaker 
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amplification value S is lower than 24 dB, the echo rernoval is performed 
for the signal Sdd) in the echo canceller 15. In contrast. In cases 
v.±ierB the speaker atoplif ication value S is equal to or higher th^n 
24 dB, an echo r^^ooval value of the echo canceller 15 is set to 0 (that 
5 is to say, pseudo echo SE(i)=-0)^ and no echo removal is performed. 
Here, in this example, the pseudo echo SE{i) is set to 0. However^ 
it is applicable that the pseudo echo SECi) bs set to a value near 
to zero on condition that a degree of the suppression of the pseudo 
echo is set so as to suppress the occurrence of ]ioi3e- 
i'j 10 AlfiOr the amplitude of the received input signal Rd(i) input to the 
'^jj adaptive filter 16 of the echo canceller 15 is att^lif ied in the adaptive 

M filter 16 according to a degree of the change of the speaker 

amplification value For example, in cases where the speaJcer 

m 

ffj amplification value S is changed from -6 dB to -f5 dB, the amplitude 

15 of the received input signal Rd(i) is an^lified by +12 dB equivalent 
^13 to a degr^fi of the change of the speaker amplification value S- Also, 

.jj for exan^ile, in cases where the speaker amplification valu6 S is 

changed from +6 dB to 0 dB of the reference level, the amplitude of 
the received ir^ut signal Rd(i) is air$>lified by -6 dB equivalent to 

20 a degree of the change of the speaker amplification value S. As is 
described above/ in the adaptive filter 16^ filter coefficients h(n) 
are calculated according to both the received input signal 
Rd (i) aitplif i^ and the residual signal U (i) , and ths pseudo echo SB (i) 
is calculated by using the filter coefficients bCn} and the received 

25 input signal Rd{i) . HerSr it is not necessarily required to amplify 
the received input signal Rd{l) input to the echo canceller 15 in the 
adaptive filter 16 according to the speaker amplification value S, 
but it is applicable that a received input signal Rd(i) amplified 
according to the speaker airplification value S in the outside of the 

30 echo canceller 15 be input to the echo canceller 15. 
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Also, in the echo suppressor 16, a degree of attenuatiion 
corresponding to the suppression of the resiciual signal U(i) output 
from the echo canceller 15 is chancred according to the speaker 
an^lificatioxi value 5. In detail. In cases where the speaker 
5 amplification value S output txom the controX CPU 9 is equal to or 
higher than 10 dB (or level A) , the residual signal U(i) output from 
the echo canceller 15 is considerably attenuated (for exaicple/ -40 
dB) - Also, in cases where the speaker amplification value S is lower 
than 18 dB, the residual signal UCl) is slightly attenuated (for 

10 example, -10 dB) , and the traixOTiitting output signal td(i) is output. 

Fig, 3 is a flow chart describing an operation of the echo canceller 
15 arranged in the echo processing unit 6, and Fig. 4 is a flow chart 
describing an operation of the echo suppressor 16. Hereinafter, an 
operation of the echo processing unit 6 will be described with 

15 reference to Fig. 3 and Fig. 4. In Fig. 3, the speaker arrplification 
value S i3 input from the control CPU 9 to the echo canceller 15 (step 
1) / and the received input signal Rd (i) is Ir^ut to the echo canceller 
15 (step 2} . Thereafter, the received input signal Rd(i) is airplified 
according to a degree of the change of the speaker amplification value 

2 0 S (step 3) , and the speaker amplification value S is con¥>ared with 
a threshold value TH(B) (equal to 24 dB) (step 4), 

In cases where the speaker airplif icatlon value S is equal to or higher 
than 24 dB in the ^tep 4, a consldjarably large non-linear distortion 
is formed in the input signal 5d(i), and there i3 prohabillty that 

25 a degraded sotand is added to the input signal Sd{i) in the echo removal 
for the Input signal Sd(i) . 'Therefore, in the step 4, the speaker 
aicplif ication value S is compared with the threshold value TH (B) (equal 
to 24 dB) to judge whether or not the echo removal is performed for 
the signal Sd(i} . In the step 4, in cases where; the speaker 

30 amplification value S is equal to or higher than 24 dB, the pseudo 
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echo signal SE(i) ig deterniined to 0 (st&p 5), the p3eUido echo signal 
SE(i) set to 0 is subtracted from, the signal sdCi) including an echo 
(step G) , and tlie residual signal U(i) is output to the echo suppressor 
18 (step 7) • Hersr the subtraction of SE(i) set to 0 firom the signal 
5 Sd(i> including an echo denotes the performance or no echo removal. 
In contrast, in case3 where th6 speaker awplification value S is 
lower than 24 dB in the step 4, the pseiido echo signal S^tx) is 
calculated in a step 9 from the filter coefficients h[n) and the 
received input signal Rd(i) already obtained, the pseudo echo signal 
10 SE(i) is subtracted from the slgiaal Sd(i) including an echo (step 6), 
=i3 and the teaidual signal U(i) is output to the echo suppressor 18 (ste(p 

m 7) . 

Thereafter, in a step 8, the filter coefficients hCn) are calculated 
f rocaboth the received input signal Rd(i) and the residual signal U (i) , 
^ 15 and the procedure returns to the step 1. 

ip Thereafter/ as shovxn in Fig. 4, the speaker axnplif ication value S 

is input from the control CPU 9 to the echo suppressor 18 (step 12), 
and the received input signal Rd(i) is input to the echo suppressor 
18 (step 13) , Also, the residual signal U<i) is Input from the echo 

20 canceller 15 to the echo suppressor 18 (step 14) , In the echo suppressor 
18, a ehort-timc power of the received input signal Rd<i) is, for 
exactiple, calculated, and it is judged that a time period^ in which 
the value of the short-time power is egual to or higher than a certain 
threshold value, is a voice uttering period of th6 f ar-6nd caller <step 

25 15) . Thereafter, the speaker axtiplification value S in the voice 

uttering period of the far-end caller judged in the step 15 is coicspared 
with a threshold value ra(A) 18 dB) (step 16) . 

In cases where the speaker aiaplification value 3 is eqfual to or higher 
than 18 dB, the precision of the eatiiratton of the filter ooefficients 

30 h{n) is degraded due to a large non- linear distortion occurring in 
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the Input signal Sd(i) . Also, a residual echo ig included in the 
residual signal U(i) output from the echo canceller 15. Therefore, 
in the step IS, the speaker amplification value 5 is cctwvpared with 
the threshold value TH(A) (= 18 dB), and it i3 judged whether or not 
5 a degree of the attenuation of the residual signal U(i) is enlarged. 
As a result of the comparison ot the speaker an^lif ication value S 
with the threshold value TH(A) {= 18 dB) (step 17^ , in cases where 
the speaker amplification value S is equal to or higher than 18 dB, 
a degree of the suppression of an echo is etnlarged (step 18) , and the 

10 residual signal U(i) is suppressed (step 19) . Thereafter/ a 

transmitting outpfat signal Td(i>/ of which an echo is suppressed to 
a large degree of the attenuation (for exaic^ile, -40 dB), is output 
{step 20) . In contrast, in cases where the speaker arnplif ication value 
S is lower than 18 dB, a degree of the suppression of an echo is lessened 

15 (for exanple, -10 dB) in a step 21, and the residual signal U(i) is 
suppressed (Step 19) . 

2^ is described above / in cases v*iexe the speaker amplification value 
S is equal to or higher than a prescribed level such as 24 dB described 
above, a large non-lineair distortion occurs in the signal Sd(i) input 

20 to the echo processing unit 6^ and there is probability that a degraded 
sound Is added to the signal Sd(l) due to the echo removal for the 
signal Sd(i) • Therefore, the echo canceller 15 is arranged In the echo 
processing unit 6 to judge according to the speaker amplification value 
S output from the control CPU 9 whether or not the echo removal should 

25 be perfoacmed. ik:cord±ngly, a timeperiody in which a signal equivalent 
to a degraded sound is added to the signal Sd{i) at high probability 
due to the echo removal^ can be reliably detected. Also, because a 
degree of the echo removal is controlled to 0 (that is to say^ the 
pseudo echo SE (i) =0) in the time period corresponding to the degraded 

30 sound addition at high probability, the echo reinoval is stopped/ and 
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the adciitlon of a degraded sound to the transmitting signal can be 
prevented. 

Also/ because the echo canceller 15 is ajrrangecliu tUe edio processing 
unit 6 to change a degree of the airplif ication of the received input 
5 signal Rdd) according to a degree of the change of the speaker 
amplification value S, it is possible to make the received Input signal 
Rd(i) Input to the adaptive filter 16 agree with the level of the 
received output signal output from the ^speaker ait^lifying unit 8 with 
accurate. Therefore, even though tbe speaker aicplification value S 
10 is changed/ the filter coefficients h(n) are properly calculated in 
p the adaptive filter 16, and the pseudo echo SE (i) similar to an actual 

U echo can be calculated in the adaptive filter 16 . Accordingly, the 

n 

echo can be properly removed in the subtracting unit 17- 
Also, in cases where the speaker arnpllfi cation value S Is equal to 
15 or higber tbari another prescribed level such as 18 dB described above^ 
ii there is probability that a residual echo reiaaina in the residual 

I? signal U(i) output from the echo canceller 15 due to the degradation 

at the echo recaoving performance of the echo canceller 15. Therefore, 
an echo coimponent not removed in the echo canceller 15 can be suppressed 
2 0 by enlarging a degree of the attenuation for suppressing the output 
of the echo canceller 15 in the echo couf^pressor 18, 

In the configuration of the voice coiaraiinication device 1 shovm In 
Fig. 1 and Fig* 2, the volume control unit 2^ the speaker 10 or the 
microphone 11 is not included in the voice communication device 1, 
25 That is to say, in an assumed use condition of the voice caramuni cation 
device 1, the speaker volume is adjusted by using a volume control 
unit of an on~vehicle audio device or a domestic audio device, and 
voice is input to a microphone and is output f txm a speaker. However, 
it is applicable that the volume control unit 2, the speaker 10 and 
30 the jniqrophone 11 be included in the voice cogmnunicatlon device 1. 
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Also, it is applicable that an image displaying tmit sucht as a 
liquid-crystal display or a cathode ray tube (CRT) and an image 
inputting imit such as a charge coupled device (CCD) camera be included 
In the voice comrauni cation device 1 in addition to the volume control 
5 unit 2, the sp&ak&r 10 and the microphone 11, In this caae, the voice 
coiTOuriication device 1 can be U36d a3 a portable visual telephone in 
which visual information is transmitted and received as well as audio 
information . 

In the above description/ the voice oamimunication device 1 con?>rises 
3 0 the echo processing unit 6 having the echo canceller 15 and the echp 
^iJ suppressor 18, and an echo i3 reduced according to the speaker 

|ij an^lification value 3 in the echo processing unit 6, However, it is 

J'^ applicable that the echo processing unit € have either the echo 

^^^3 canceller 15 or the echo suppressor 18, For exai^ple, in case of the 

^ 15 echo processing unit 6 having the echo canceller 15, a time period. 



in which a signal equivalent to a degraded sound is added to the signal 
Sdfl) due to the echo removal^ can be detected by using the speaker 
amplification value S a parameter for judging whether or not the 
echo removal should be pexforroed. Al^o^ because a degree of the 

2 0 airplif ication of the received input signal Rd(i)is changed according 
to a degree of the change of the speaker aaoDpllfication value S, it 
is possible to make the received input signal Rd(i) input to the 
adaptive filter 16 agree with the level of the received output signal 
output from the speaker aniplifying lanit 8 with accurate. Therefore, 

25 the pseudo echo SE(i) similar to an actual echo can be calculated. 
Al£o, in case of the echo processing unit 6 having the echo suppressor 
18/ beca\ase a degree of the attenuation for suppressing a signal 
including an echo is changed, the ec2io can be efficiently suppressed 
according to the strength of the echo included In the signal . 

30 Here, as shown in Fig. 5/ it is applicable that the operation 
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described, with, reference to Fig. 3 be performed by changliicf an order 
of the steps of the procedure* In Fig. 5, the 3tep3/ which are 
equivalent to or the same as tliose 9}x)wxx in Fig. 3r are indicated by 
the same step numerals as those shown in Fig. 3- 

5 

In the voice coitEmmication device according to the first embodiment^ 
in cases where the speaker amplification value S is equal to or higher 
than a prescribed level (24 dB) ^ a considerably large non-linear 

10 distortion occurs in the signal Sd(i) input to the echo processing 
unit 6. and thftre is probability that a degraded sound Is added to 
the signal Sd (i) due to the echo removal for the signal Sd(i) . Therefore, 
the echo canceller 15 is arranged to perform no echo reffooval in cases 
vdiere the speaker amplification value $ is equal to or higher than 

15 the prescribed level. However, even though a degree of the rejooval 
of an echo is controlled for the removal of the echo by attenuating 
the pseudo echo SE (i) by a constant value, the addition of a degraded 
gound to the gignal Sd(i) can be prevented. 

In a voice ccHnniunication dervice according to a second enxbodiment 

2 0 of the present invention, in cases where the speaker anplificatlon 

value S IS equal to or higher than a prescribed level, the echo removal 
is performed in an echo canceller by using the pseudo echo SE(i) 
attenuated by a constant value. 
Fig* 6 is a flow chart describing an operation of an echo canceller 
25 of a voice coamnunication device according to a second embodiment of 
the present invention. The steps agreeing with or before the step 4 
of the flow chart shown in Fig. 6 are the same as the steps 1 to 4 
of the flow chart shown in Fig. 3, and additional description of the 
steps is omitted* 

3 0 In the step 4 shown In Fig. 6, in cases where the speaker amplification 
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value S Is equal to or higher: tJUan a pre3ci:ibecl threshold value TII(B) 
52^ dB)i- ^ pseudo ectio SE(i) is calculated in a £tep 23 by usirig the 
filter coefficients h(n) previously determined. Thereafter/ the 
pseudo echo SE(±) calculated in the step 23 is multiplied by a factor 
5 P (0< j3<1) to attenuate the p3BUdD edho SE (i) by a cou^taut value (step 
24) f the attenuated pseudo echo SE(i) is subtracted from the signal 
Sd(i) (step 25) to perform the echo removal* Here, the factor 0 is," 
for examcple/ set to 0.5. 
After the completion of the above-described steps of the procedure, 

10 the atep 7 and the at^p 8 are performed, and the proc&dure is 

transferred to the step 1» In contrast, in the step 4, in cases where 
the speaker amplification value S is lower than the prescxibed 
threshold value TH(B) (24 dB) , the procedure proceeds to the step 9, 
a pseudo echo SE<i) is calculated, and the procedure is returned to 

15 the step 25. 

As is described above, in cases where the speaker amplification value 
S is equal to or higher than a prescribed level such as 24 dB described 
above, a considerably large non- linear distortion occurs in the signal 
Sd(i) input to the echo processing unit 6, and there is probability 

2 0 that a degraded sound is added to the signal SdCi) due to the echo 
removal for the signal Sd(i) . Therefore, it is judged according to 
the speaker amplification value S output from the control CPU 9 "whether 
or not there is high probability that a signal equiveilent to a degraded 
sound is added to the signal Sd(i) due to the echo retnoval for the 

2 5 signal Sd(i) * In cases where there is high probability that a degraded 

sound is added to the signal Sd(i)/ a degree of the echo removal is 
controlled by using the pseudo echo SE(i) attenuated by a constant 
valve, and the echo is r^noved. Therefore, the addition of a degraded 
sound to the transjnitting signal can be prevented. 

3 0 Here, as shown in Fig. 7, it is applicable that the operation 
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described with, reference to Fig. 6 be perf ormcid by changixig an order 
of the step3 of the procedure. In Fig. 1, the steps, which are 
equivalent to or the s^me as tho^tei shown in Fig- 5 or Fig. 6, are 
indicated by tlie same step munerals those shown in Jsig. 5 or Fig, 
5 6. 



^0 



t3 



msoDiMEirr 3 

In the voice coraramication device according to the first ecnbodiKieint, 
in ca3G3 where the speaker anplif ication value S is equal to or hi^er 
1 0 than a prescribed level {24 dB) , a considerably large non-linear 
distortion occurs in the signal Sd(i) input to the echo processing 
unit 6, and there is probability that a degraded sound is added to 
the signal Sd(l) due to the echo removal for the signal Sd(i) . Tberefore, 
the echo canceller 15 is arranged to perform no echo removal in cases 
15 Where the speaker amplification value S is equal to or higher than 
the prescribed leviel. However, in cases vflier^ the speaker 
amplification value S is set to be equal to or higher than th^ 
Q prescribed lefvel {24 dB) , it is preferred that the renewal of the filter 

coefficients h(n) based on a sequential calculation is stopped/ a 
2 0 pseudo echo SE(i) is calculated according to the filter coefficients 
h(n) which are determined before the setting of the speaker 
amplification value S to th© prescribed IotqI (24 dB) , a degree of 
the echo removal is controlled by uging the pseudo echo SE{i), and 
an echo included in the signal Sd(i) is removed* Also, when the speaker 
25 arcipiification value S is set to be lower than the prescribed level 
(24 dB) , it is preferred that the renewal of the filter coefficients 
h(n) based on the SBquential calculation is restarted, and a pseudo 
echo SE(i) is calculated according to the filter coefficients h(n) 
wliich are determined according to the sequential calculation* 
30 In a voice comnunication device according to a third embodiment of 
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the present invention, in cases Whsre the speaker amplification valxi^ 
S is equal to or higher th^ a presdtibed level, ^ pseudo echo SE(i) 
is calculated according to the filter coefficients h(n) Which are 
determined before the setting of tlie Bpeaker amplification value S 
5 to a value equal to or higher than the prescribed level (24 dB), and 
the echo removal is performed in an echo canceller by using the pseudo 
echo SE(i} - 

Fig*^ 8 i3 ^ flow chart describing an operation of an echo canceller 
of a voice conninunication device according to the third embodiment of 

10 the present invention. In Fig, 8, the step numerals/ which are the 
samB as those of Fig, 3, indicate the same steps as or the equivalent 
to those of Fig. 3- 

In the step 4 of Fig, 8, in ca^es where the speaker amplification 
value S is equal to or higher than a prescribed threshold value 1?H(B) 

15 (24 da) r the procedure proceeds to a step 38, and the filter 

coefficients h<n) deterrained before the setting of the speaker 
amplification value S to a value equal to or higher than the prescribed 
level (24 dB) are read out from, a jneimory (not shovm) . Thereafter, a 
paeado echo SE(i) ig calculated according to the filter coefficients 

20 h(nl which are read out in the step 38 (step 39) , the pseudo echo SB (i) 
calculated in the step 39 is subtracted from the signal Sd(i) to remove 
an echo included in the signal Sd(i) (step €) . 

After the canotpletion of the above-described steps of the procedure r 
the step 7 and the step 8 are perfonned, and the procedure is 

25 transferred to the step 1. In contrast/ in the step 4/ in cases where 
the speaker anplification value S is lower than the prescribed 
threshold value TtKB) (24 dB) r the procedure proceeds to the step 9. 
Thereafter, ae is described in the first enibodiaient, the steps 6 to 
8 are performed, Herc^ the filter coefficients h(n) calculated in the 

30 step 9 are stored in a memory. 
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As is described above, in this einbodijaeTit , in cases where the speaker 
aifiplif ication value S is equal to or higher than a prescribed level 
3Uch as 24 dB de3cribed above, a considerably large non-linear 
distortion occurs in the trax>smitting speech digital signal 3d(i) 
5 input to the echo procesBing unit 6, and there is probability that 
a degraded sound is added to the signal Sd(i) due to the echo removal 
for the signal Sd(i] . Therefore, it is judged according to the speaker 
anrplification value S output from the control CPU 9 whether or not 
there is high probability that a signal eqoivalent to a degraded sound 
10 is added to the signal Sd(i) due to the echo removal for the signal 
Sd (i) . In cases where there is high probability that a degraded sound 
jP; is added to the signal Sd(i)/ a pseudo echo SE(i) is calculated by 

U5lng the filter coefficients h(n) which are detenained before the 
la setting of the speaker amplification value S to a value eqaal to or 

T 15 higher than a prescribed level (24 dB) , and the echo is removed frora 
'2 the sigixal Sd(i) * Therefore, the addition of a degraded sound to the 

1'^ transmitting output signal Xd{i) cen be prevented, 

i;j In the above description, in cases where the speaker ainplificatxon 

' " value S is set to a value equal to or higher than a prescribed level, 

2 0 in the echo processing unit 6, a pseudo echo SE(1) Is calculated 
according to the filter Coefficients h (n) which are determined before 
the setting of the speaker anplification value S to the prescribed 
level (24 dB) , and the echo is removed from the signal Sd(i) . However, 
a pseudo echo SE(i) is not calculated according to the filter 
2 5 coefficients hln) vtfiich are detennined before the setting of the 
3peakar amplification value S to the prescribed level, but it is 
applicable that a pseudo echo SE(i) be calculated according to the 
filter coefficients h<n) registered in advance . 
Here, as shown in Fig. 9, it is applicable that the operation 
30 de3crlhed with reference to Fig. 8 be performed by changing an order 
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of the; steps of the procedure* In Fig, 9, the steps, which are 
equivalent to or the same as those shown in Fig. 5 or Fig. 8, are 
indicated by the same step numeral^ as those shown in Fig* 5 or Fig. 

5 

EMBODIMENT 4 

In the voice cowmuiii cation device according to the first embodiraent, 
as is described in the step 3 of Fig, 3^ the received input signai 
Rd(i) is anplified in the echo canceller 15 according to a degree of 

1 0 the change of the speaker amplification value S. However, the received 
input signal Rd(i) is not amplified in the echo canceller 15 according 
to a degree of thfe change of the speaker an^^iificatlon value S, but 
it is prsf erred that the filter coaf f Icients h (n> are changed by only 
DDCultiplydng once the filter coefficients h (n) by an adjustment value 

15 cc corresponding to a degree of the change of the 3peaker amplification 
value S. 

h(n) = aX li(n) (n = 0 to N-1) (4) 
Fig. 10 is a flow cihart describing an operation of an echo canceller 
according to a fourth eniibodiTttent * In Fig. 10, the step numerals^ which 

20 are the saaue as those of Fig. 3, indicate the aairte steps as (or the 
steps equivalent to) those of Fig. 3. As ia described In the first 
embodiirienty- when the speaker amplification value S and the received 
input signal Rd(i} are input to the echo canceller 15 in the stepsi 
1 and 2f the filter coefficients h(n> corresponding to the spea3cer 

25 amplification value S are calculated according to the equation (4) 
in a step 22 • Here, in cases where the speaker amplification value 
S iS/ for example, changed from +-6 dB to +12 dB within 0*8 second, 
it is judged in the echo canceller 15 that the change of the speaker 
amplification value S is equivalent to the anpliti cation of € dB, an 

30 adjustment value a equal tjo 2 is set in the echo canceller 15, and 
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the filter coefficients h(n) are calculated by using th.e acijuatraent 
value Qt- Also, in cases where the speaker anrplifxcation value S Is, 
for exanqplG/ changed from 0 dB to -6 dD^ it is judged in the echo 
canceller 15 that the change of the speaker anrplif ication value 5 is 
5 equivalent tc the anrplif ication of -6 dB; an adjustment value t^t equal 
to 1/2 is set in the echo canceller 15, and the filter coefficient^ 
h<n) are calculated by using the adjustment value a. After the 
inultiplication of the filter coefficients h (n) by the adjustinent value 
ot is once performed, a sequential calculation of the filter 

10 coefficients hCn) is performed t>y using the ictultiplied filter 
coefficients h(n) as initial values. 

Here, the received input signal Rd(l) is not aiC5>lified according 
to a degree of the change of the speaker ainplif ication value but 
the filter coefficients h(n) are changedby using the adjustiaent value 

15 a corresponding to the change of the speaker arnpl if ication value Sr 
and the echo removal process is performed. In this case, as shown in 
Fig. 10, because the echo removal process is the same £ls that of the 
steps 6 to 9 of Fig. 3, additional description of the echo removal 
process in the Steps 6 to 9 is omitted. 

20 As is described above, the filter coefficients h (n) are changed by 
raultiplylug the filter coeff^icients h(n) by the adjustment value a 
corresponding to a degree of the change of the speaker aii¥>lif ication 
value S . Also, even though the speaker ainplif ication value S is changed, 
proper filter coefficients h(n) are obtained by performing the 

2 5 jmltiplication of each filter coefficient h (n) by the number of filter 
coefficients. Therefore, a calculation volume is coit^aratively low, 
and the pseudo echo SE (i) is produced* Accordingly, the echo included 
In the signal Sd{i) can be removed. 
Also, the filter coefficients h (n) are changed in cases vihere a degree 

30 of the change of the speaker airiplif ication value 3 is larger than a 
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predetermined degree of the change within a prescribed time perlod- 
Therefore, in cases Where the speaker art^Ilfication value S is 
moderately changed in a time period longer than the prescribed time 
period so as to properly renew the filter coefficients h(n)r there 
5 is no case where the filter coefficients h(n) are erraneously changed, 
and the echo included in the signal Sd(i) can be properly rentDved- 

EMBODIMENT 5 

In the voice coixwwnication device accjording to the f oiirth enibodiment/ 
10 the received input signal Rd (i) is not aicplif ied in the echo canceller 
15 according to a degree of the change of the speaker ar^lification 
value S, but the filter coefficients h{n) are changed by only 
iDUltiplying once the filter coefficients h (n) by the adjuatment: value 
at corresponding to a degree of th6 Change of the speaker asiplif ication 
15 vaJlue S according to the equation (4) . However, in cases where the 
adjustment value a is largely heightened (or largely low^ered) because 
a degree of the change of the speaker amplification value S is large, 
there is probability that a considerably discontinuous change occurs 
in the pseudo echo SE (i) calculated from the filter coef ficients h(n) . 
2 0 In cases where the removal of the echo included in the eignal Sd(i) 
is performed by using the pseudo echo SE{i) changed considerably and 
discontinuously, there is probability that a d^radiad soimd is added 
to the residual signal U(i) not including the echo. 
Therefore, in an echo canceller 15 of a voice coiranuaication device 
25 according to a fifth embodiment/ in cases where a degree of the changs 
of the speaker anpllfication value S is larger than a predetermined 
value/ a divided multiplication of th6 filter coefficients h(n) by 
a partial coiryponent of the adjustment value a ±s serially performed 
several times to substantially perform the multiplication of the 
30 filter coefficients h(n} by the adjustment value a.. In detail, in 
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cases where t:h.G speaker air^lificaticrx value S is, for exarapler changed 
by +12 dB or more within 0,8 second, a divided multiplication of the 
filter coefficients h(n) is perfonned several times by using partial 
caii5>on^ts of th^ adjustment value ot . To perform the multiplication 
5 of the filter coeffici^ts h(n) by a desired adjustment value a=4 
("2'), when each of the filter coefficients h(n} is sequentially 
calculated/ a divided laultiplicat ion of the filter coefficient h(n) 
by 2 is serially performed twice. Also, in cases where the speaker 
ait4>lificatlon value S is, for example, changed by +18 dB within 0.8 

10 second, to perform the multiplication of the filter coefficients h(n) 
by a desired adjustment value a=8 (=2^) , a divided multiplication of 
each filter coefficient h(n) by 2 is serially performed three times. 
Also,, in cases where the speaker aityplification value S is, for exaxtpl©/ 
changed by -12 dB or less within 0.8 second, a divided multiplication 

15 of the filter coefficients hCn) is serially performed several times 
by using partial components of the adjustment value t» . To perform 
the multiplication of the filter coefficients h(n) by a desired 
adjustment value a=l/4 {=[1/2]^] , when each of the filter coefficients 
is sequentially calculated, a divided multiplication of the filter 

2 0 coefficient h(n) by 1/2 is serially performed twice* In general, in 

cases where a degree of the change of the speaker amplification value 
S Is positive/ toperform the multiplication of the filter coefficients 
h (n) by a desired adjustment value a-2'', a divided multiplication of 
each filter coefficient h{n) by 2 is serially performed J times. In 
25 contrast, in cases where a degree of the change of the speaker 

amplification value S is negative, to perform the multiplication cf 
the filter coefficients h{n) by a desired adjustment value ot- (1/2)^ 
a divided multiplication of each filter coefficient h(n) by 1/2 is 
serially performed J times. 

3 0 Fig. 11 is a flow chart describing an operation of an echo canceller 
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according to a fifth embodiment of the present irtvention . In Fig, 11, 
the step numerals. Which ar& the same as those of Fig* 3, indicate 
tlie 55OTe 3tep3 (or the stejps ^quival^nt to) those of Fig. 3. 
Hereinafter, the process for multiplying stage by stage the filter 
5 coefficients h (n) by the adjustjoaent value a will be described with 
reference to Fig. 11- 

In the same manner as in the other ejnbodiments, when the speaker 
amplification value S is received in the echo canceller 15 in the ste[t> 
1/ a degree Dg of the change of the etpeakdr amplification value S is 
10 calculated by subtracting a past speaker amplification value Sold 
stored in a memory from the current speaker amplification value S. 

Thereafter, a division number J is set in a step 27, The division 
number J is set in the echo canceller 15 by calculating the value J 
satisfying a following equation, 
15 a=2^ (if DS^O) 

a=(l/2)*' (if D3<0) (5) 

Here, as is described in the fourth erribodiiaent, because tha 

adjustment value a corresponding to a degree Ds of the change of the 
speaker amplification value S is determined/ it is preferable that 

20 the division nurctoer J corresponding to each degree Ds of the change 
of the speaker airfjlification value S b6 set in a memory in advance, 
Ibereafter, a counter value j is reset in a ^tep 2B, and it is judged 
in a step 29 whether or not the division number J is equal to 0. In 
case of J=0, the procedure proceeds to a step 37, a counter value k 

25 is set to a predetermined constant value K, and the procedure proceeds 
to the st^ 2. 

In contrast, in cases Ti*^ere it is judged in the st^ 29 that the 
division number J is not equal to 0, a stage-by-stage adjustment of 
the filter coefficients htn) is performed in a step 30 by using a 
30 following equation. 
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h(n) = 2 X h<n) (if Ds>0) 

hin) = (1/2) X h(n) (if Ds<0) (6) 

Thereafterr a counter value k is reset to 0 in a step 31, eind the 
echo removal is performed in the step 2 and the steps 6 to 9 . The process 
5 in each step is performed in the same manner as that in the first 
embodiment - 

Thereafter, the cx>uiiter value k Is Incremeoited by 1 in a step 32^ 
and the echo reoaoval process in the step 2 and the 3tep3 6 to 9 is 
performed until the counter value reaches the cousteuoit value K (step 
10 33) • Therefore, in the echo canceller 15^ the echo removal process 
can be performed K tiifies according to the filter coefficients h(n) 
which are adjusted by values corresponding to one stage each time the 
process of the step 30 ia performed. 
Thereafter, the counter value j is Incremented by 1 in a step 34, 
15 and it is judged in a step 35 whether or not the counter value j reaches 
a value equal to or higher than the division number J, In cases where 
the counter value j does not reach the division number J, the proceduire 
returns to the step 30. Here/ because the filter coefficients h(n) 
are again adjusted in the step 30, the echo removal process can be 
2 0 performed in the echo canceller 15 according to the filter coefficients 
h (n) adjusted in the J-th Stage by repeatedly perfoirming the procedure 
frcra the step 30 to the step 35, 

In cases where it is judged in the step 35 that the counter value 
j reaches a value equal to or hi^er than the division nuiuber the 
25 procedure proceeds to a step 3Sf and the current speaker amplification 
value S is stored as a past ^speaker arQ|>lificatlon value Sold Jju the 
echo canceller 15* Thereafter, the same processing starting froth the 
step 1 is repeatedly performed. 
As is described above^ in cases where the change of the speaker 
30 anyplification value S is large the filter coefficients h(o) are 
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multiplied by each partial caraponent. obtained by dividing the 
adjustment value a so as to gradually change the filter coefficients 
h{n) . Thereforef as coitpared with the pseudo echo SE(i) calt::xilated 
from the filter coefficients h (n) which are obtained by the single 
5 multiplication of the adjustment value the occurrence of a 

considerably discontinuous change in the pceudo echo SE(i) can be 
prevented- That is to say, as compared with a case where the filter 
coefficients h(n) are largely dhanged in one renewal operation, the 
calculated pseudo echo SE(i) is smoothly changed, and the acho- 

10 cancelled signal U(i) can be saaootlily changed. Accordingly, the echo 
can be removed from the signal Sd(i) by using the pseudo echo S£;(i) , 
and no degraded sound can bo added to the signal U(i) . 

Mso, proper filter coefficients h(n) corresponding to the change 
of the speaker amplification value S can be obtained at a conaparatively 

1 5 low calculation voluwie corresponding to the number of multiplications 
of the filter coefficients h(n) which 1^ equal to the number of the 
filter coefficients hin) ^ and a pseudo echo aimilar to an actual echo 
can be calculated from the filter coefficients h(n) corresponding to 
the change o± the speaker anplif ication value 5 and the received signal 

20 Ild(i) . Accordingly, the echo can be properly removed from the signal 
Sd{i) . 

In the voice communication device according to the fifth embodiment, 
25 in cases where the speaker amplification value S is largely changed, 
a divided multiplication of the filter coefficients h(n) by a partial 
comppn^t of the adjustment value at is serially performed several 
times to substantially perform the multiplication of the filter 
coefficients h (n) by the adjustment value a , However, in cases where 
30 a degree of the change of the speaker amplification value S is 
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considerably large (or considerably small) / even though a divided 
iitaltlpllcation of the filter coefficients h [n) by a partial component 
of the adjustment value a is aerially performed several times to 
substantially perform the raultipli cation of the filter coefficients 
5 h(n) by the adjusfcsnent value a, a considerably discontinuous change 
occurs in the pseudo echo SE (i ) calculated from the filter coefficients 
h (n) . As a result, there is probability that a degraded sound Is added 
to the residual signal U{i) not including the echo. 
Tlierefore/ in a voice coiranunication device according to a sixth 

10 embodiment, in cases where a degree of the change of the speaker 
amplification value S is larger than a predetermined value, the filter 
coefficients h(n) are reset to zero. In detail, in cases v**iere the 
speaker amplification value S is, for ©xart^ler changed by +24 dB or 
more {or -24 dB or less) within 0.8 second, the filter coefficients 

15 h(n) are once set to zeiro according to an equation (7) . Thereafter, 
the filter coefficients h (n) are renewed according to the sequential 
calculation, and the filter coefficients h(n) gradually approach 
proper values . 

h(n) = 0 (n = 0 to N-l) (7) 

2 0 Here, In this embodiment, the filter coefficients h{n) are set to 
zero. However, it is applicable that the filter coefficients h(n) be 
set to values near to zero on condition that no considerably 
dlscontinuaus change occurs in the pseudo echo SE(i) . 
As is described above, in cases where a degree of the change of the 

2 5 speaker amplification value S is considerably large, the filter 

coef f icienta h (n) are once set to zero or values near to zero • Therefore, 
as compared with a case where the filter coefficients h(n) are changed 
by multiplying each filter coefficient h{n) by a high (or low) 
adjustment value, the occu;cirence of a considerably discontinnoua 

3 0 change in the pseudo echo SE(i) can be prevented- That is to say, as 
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coirpaired with a case where the filter coefficients h.(n) are 
considerably changed by imiltiplying the filter coefficients h{n) by 
a constant value, the calculated pseudo echo SE (i) is smoothly changed, 
an echo-cancelled signal can be sinoothly changed, and no degraded soimd 
5 can be added to the echo-cancelled signal . Accordingly, in cases Where 
the actio removal i^ performed by using the pseudo echo SE(i) , no 
degraded soxuid can be added to the signal U{1) • 



EMBODIMENT 7 

10 Fig. 12 is a block diagram showing the configxiratlon of an echo 
processing unit arranged in the voice communication device and the 
configuration, of peripheral units according to a seventh ernbodiment 
J;^ of the present invention, ^ shown in Fig. 12, in an echo processing 

|H unit of a seventh embodiment ^ a double talk detecting unit 26 is 

2^ 15 arranged to detect a simultaneous voice utterixig state (or a doijble 
m2 talk) in the comrauni cation between the far-end caller and the near-end 

JJn caller and to output a result of the detection to the adaptive filter 

16. Here, the configuration other than the adaptive filter 16 is the 
same as that in the first embodiment, the constituent elements, which 
20 are the same as or equivalent to those shown in. Fig. 2, are Indicated 
by the same reference nvunerals as those of the constituent elements 
shown in Fig. 2, and additional description of those constituent 
elements is omitted, 
T^e received input signal Rd(i)/ the signal Sd(i) and the residual 
25 signal U (i) are input to the double talk detecting unit 26, and signal 
powers Rp/ Sp and Ep of these signals are calculated* 

Also, the speaker amplification value S is received in the doiible 
talk detecting unit 26, and a degree of the change of the speaker 
ati5>lification value S is calculated. 
30 thereafter^ it is checked whether or not each of following equations 
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(8) to (10) is satisfiedi and In cases where one of following cx)nciitions 
is 3ati3fl^, it ia judged in the double talk detecting unit 26 to 
be a double talk or- a f^r-end caller voiceless state. Thereafter, th^ 
result of the judgment is output to the adaptive filter 16 as a dxjuble 
5 talk judgment recult- 

Bp < PI (8) 

Sp > P2XRP (9) 

Ep > PvXSp (10) 

Condition-4 ; equation {8) i^ satisfied, 
10 Condition-5: equation (8) is not satisfied, but equation [9) is 
satisfied, 

Condition-6: equation (8) or equation (9) is not satisfied/ but 
equation (10) is satisfied* 
Symbols PI and P2 denote fixed values in the equations (8) and (9) - 

15 A symbol Pv denotes a weighting factor changing with the speaker 
amplification value S. In cases where a degree of the change of the 
speaker asiplif ication v^lue S is, for exairple, equal to cr higher than 
+12 dB Cor equal to or lower than -12 dD) , Pv is set to a value (for 
example/ Pv = Fvto +0.2) which is obtained by adding a constant value 

2 0 to a predetermined reference value Pvb. Therefore, it is difficult 
to judge that the cotnmnnication between the fai^end caller and the 
near-end caller is performed in the state of the double talk, Elso^ 
in cases where a degree of the chajnge of the speaker arc$>lification 
value S is lower than +12dB and higher than -12 d^, 5*v is set to the 

25 reference value Pvb. 

In cases Where the double talk judgment result indicates the double 
talk^ the renewal of the filter coefficients h(n) is stopped in the 
adaptive filter 16. In contrast, in cases where the double talk 
judgment result indicates no double talk, the filter coefficients h (n) 

30 are renewed in the adaptive filter 16. 
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Fig. 13 is a flow chart dEJScribing an operation of the ectio canceller 
15 of the voice comnunlcation device according to the seventh 
embodiment. In Fig. 13, the step nuaverals, i;^ich are the same as those 
of ^xrj. 3 or Fig, 8, indicate th^ same steps aa (or the steps equivalent 
5 to) those of Fig* 3 or Fig. 8- 

In cases where the speaker amplification value S is lower than a 
prescribed threshold value TH{B) {24 dB) in the step 4 of Fig. 13, 
the procedure proceeds to a step 40. In the step 40^ in cases where 
a degree of the change of the speaker araplif icatlon value S i^ equal 

10 to or higher than +12 dB (or equal to or lower than -12 dB) , Pv is 
set to the value of Fvb + 0.2 • ^so, in cases where a degree of the 
change of the speaker aittplif ication value S is lower than +12dB and 
higher than -12 dB, Pv is set to the reference value Pvb. Thereafter, 
in a step 41, it is judged according to the equations (8) to (10) and 

15 the condition-4 to the condition- 6 whether or not the coramcunication 
between the far-end caller and the near-end caller is performed in 
the 3tate of the double talk. In cases where it is judged in the step 
41 to be the double talk, the procedure proceeds to a 3t^p 42, filter 
coefficients h (n) calculated before the judgineut to be the double talk 

2 0 are read out from a memory (not shown) * These filter coefficients h (xi) 

are used to calculate a pseudo echo SE(i) in a step 39* 

In contrast, in cases where it is judged in the step 41 to be no 
double talk, the procedure proceeds to the step 8, the filter 
coefficients h(n) are renewed, the filter coefficients h(n) 
25 calculated in the step 8 are stored in the memary in a ^tep 32, and 
the procedure proceeds to a step 3$. 

As is described above, in case of the double talk, no filter 
coefficients h(n) are renewed. Therefore, even though a non-linear 
distortion occurs in the signal Sd{i) ixiput as an echo so as to degrade 

3 0 the precision of the estrtoation of the filter coefficients h(n>, the 
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echo removal caix be continued. 

In this Btftbcdimcint, the renewal stop or start of the filter 
coefficient3 hCi\) in case of the judgment to be the double talk is 
applied for the echo canceling process of the third embodiment shown 
5 in Fig. 8 as an example. However, the process of the renewal stop is 
not lircdted to the echo canceling process of the third erribodiiuBnt^ 
but the process of stopping the renewal can be applied for the other 
erobodimexT,t3 in the same manTLer. 
Next/ an operation of the echo suppressor 18 will be described. 
10 The double talk judgment result is output froan the double talk 
detecting \Anit 26 to the echo suppressor 18. In the echo suppressor 
iu 18^ a degree of the echo suppression In a non-double- talk time period, 

jj^^ in which it is Judged to be no doiible talk, is set according to the 

double talk judgment result so as to be larger than that in a 
- 15 double-talk time period in which it is judged to be the double talk, 

=p and the amplitude of the residual signal XJ(i) in the non-double-talk 

lij timeperiodis suppressed mo re than that in the double-talk time period* 

J'^ Here/ as an exaicpie/ a degree of the eciio suppression can be set to 

6 dB in the double-talk time period, and a degree of the edho 
20 suppression can be set to 24 dB in the non-double- talk time period. 

In this eiftbodiment, it is preferable that the received iiiput signal 
Rd(i) be si^presaed according to the double talk judgment result as 
well as the residual signal U(i) . 
As is described above, in cases where a degree of the change of the 
2 5 speaker amplification value S is large, the constant value Pv for the 
power 1^5 of the residual signal Ud) in the equation (10) of the double 
talk judgment is changed, and probability of the judgment to be the 
double talk is lessened- Therefore,^ even though the echo removal based 
on the filter coefficients h (n) properly calculated cannot be properly 
30 performed due to the large degree of the change of the speaker 
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aii5>llfication value S and the power Ep of the residual signal U(i) 
is enlarged, it is prevented that the renewal of the filter 
coefficients hdil is stopped due to the erroneous judgment to be the 
double talk. Accordingly, the filter coefficients h(n) gradually 
5 approach proper values, and the echo can be properly removed. 

Also, even though the speater anrplification value S is largely 
changed, it is prevented that the communication between th^ far-end 
caller and the near-end caller is erroneously judged to be the double 
talk, and the residual signal U(i) is properly :Sl^pressed. Therefore, 
10 an echo conqponent not removed in the echo canceller 15 can be 
suppressed. 

Here, the use of the echo coiapressDr with the echo canceller is not 
limited to this (wmbodlment . For exaitple, the echo compressor can 
used with the echo canceller described in each of the other embodimsnts . 
1 5 Also/ the echo con^cpressor can be used with each of v^ious conventional 
types of echo cancellers, 

EMBODIMENT 8 

Each of the voice coinnrunication devices according to the first to 
20 seventh embodixoents has the echo processing unit 6 which comprises 
the echo canceller 15, having the adaptive filter 16 and the 
subtracting unit 17 , for performing the echo removal according to the 
speaker aroplification value S output txom the control CFU 9, and the 
echo suppressor 18 for suppressing the output of the edio canceller 
2 5 15 according to the speaker airplification value S output from the 
control CPU 9 vAiile changing a degree of the attenuation corresponding 
to the suppression* tiowever, the operation performed in the echo 
canceller 15 and the operation performed in the echo suppressor 18 
can be perf ooaed in a software process . Hereinafter, a voice 
30 cororounication device performing the operation in the echo canceller 
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15 and t±Le operation in the echo suppressor 18 la a software process 
will be described* 

Fig, 14 ±s a block diagram showing the configuration of a voice 
coiamunication device according to an eighth eattbodiment of the present 
5 Invention. In Fig* 14 ^ 19 indicates an echo reduction processing unit 
formed of a digital signal processor (hereinafter, called DSP) * 20 
indicates a received signal input port . 21 indicates a received signal 
output port. 22 indicates a speaker an^lification value ir^ut port. 
23 indicates a transmitting signjil input port. 24 indicates a 
10 transmitting signal output port. 25 indicates an echo processijig 
-3 processor. In Fig. 14, the constituent elements^ which are the same 

IIU as or equivalent to those shown in Fig* 2 or Fig- 12 ^ are indicated 

by the same reference numerals as those of the constituent elements 
^ shown in Fig. 2 or Fig* 12, and additional description of those 

* 15 constituent elements is ccaitted. 

The echo processing processor 25 comprises the DSP 19 performing 
the echo reduction process, the received signal input port 20 at which 

* - the received ir^ut signal Kd(i) isreceivnd, the received signal output 

port 21 frcra which the received input signal Rd(i} is output, the 

2 0 speaker amplification value input port 22 at which the speaker 

arc^jlification value S sent from the control CPU 9 is received^ the 
transmitting signal input port 23 at which voice given by a terminal 
user ia received as a signal Sd{i) through the microphone 11^ the 
microphone axaplifier 12 and the A/D convertsr 13, and the tranfcmltting 
25 signal output port 24 from, which a transmitting output signal Td[i) 
obtained by performing the echo canceling process and the echo 
suppressing process is output • 

Next, an operation will be described below. The speaker 
amplification value S corresponding to the speaker volume adjusted 

3 0 in the volume control unit 2 is output from the control CPU 9 to the 
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DSP 19 tihrough the speaker aicplification value input port 22 of the 
echo proceaaing processor 25 • Thereafter, the speaker amplification 
value S isr for exaicpl^, read out from the speaker aifplification value 
input port 22 accoix5tag to a sioftware tool stored in the DSP 19 at 
5 prescribed time intervals (for exairple, every sampling cycle of voice 
samples) . Thereafter, the echo canceliag process and the echo 
suppressing process are perfonred in the DSP 19 according to the 
sipeaker anipllfication value S read out. The echo canceling process 
ajnd the echo auprpresslng process are the sanie as those described in 

10 each of the first to seventh euibodimenta with reference to Fig. 3 to 
Fig. 13, and additional description of the echo canceling process and 
the echo suppressing process is omitted* 

As is described above, the voice communication device comprises the 
echo processing processor 25, functioning as an echo processing unit, 

15 for performing the operation, which is peurf armed in both the echo 
Canceller 15 and the echo suppressor 16 shown in each of Fig. 1, Fig. 
2 and Fig. 12^ in a software process • Therefore, because the echo 
canceling process and the echo ai^ppteasing process ate performed 
according to the speaker amplification value 5 received from the voice 

2 0 control unit 2 in the voice cortmunication device having the simple 
configuration, the same effects as those obtained in the voice 
communication devices of the first to seventh embodiments can be 
obtained in the voice CGHtQamication device* 
Also, because the echo reduction processing unit 19 is formed of 

2 5 the DSP, the echo canceling pTOce3s erid the &cho guppnesaing process 

can be flexibly changed according to the change of the speaker 
airqplificatlon value S. 

Also, because an echo canceller and an echo suppressor are 
substantially obtained as a software tool, the operation of the echo 

3 0 canceller and the echo suppressor can be Immediately changed according 



^0 
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to the change of the speaker amplification value S. 

In the above-deacrtbed voice coimnunicatian device, the speaker 
airplif ication valu^ S is read out froia the speaker aiaplifl cation value 
input port 22 according to a software tool of the DSP 19 at prescribed 
5 time intervals, and the echo cajiceling pro<!tes3 aiid the echo suppressing 
process are changed according to the change of the speaker 
amplification value S. However, when the speaker amplification value 
S is output f roia the control CPU 9 to the speaker anqplif icatlon value 
input port 22 of the DSP 19, it l3 preferable that the Interruption 
10 processing be performed for the DSP 19 so as to change the edio 

canceling process and the echo suppressing process in response to the 
interruption processing. 

Mso, in the above-described voice communication device, only both 
the echo canceling process and the echo si^pressing process are 
15 performed in the DSP 19. However, it is preferable that a function 
for the voice codec process be additionally included in the DSP 19. 

Also, in cases where the echo processing processor is arranged in 
an on-vehicle telephone or a portable telephone, an echo processing 
function can be easily added to the- vehicle telephone or the portable 

2 0 telephone • 

JUso, in the above description, an example of the performance of 
both the echo canceling process and the echo suppressing process 
according to the speaker amplification value S output from the control 
CPU 9 is descr-ibed. However, in the first to eighth embodinents, it 
25 is preferable that the speaker amplification value S be detected or 
received from another unit in place of the reception of the speaker 
amplification value S from the control CFU 9 to perform both the echo 
canceling process and the echo suppressing process . 
As is described above, a voice comtiunication device of the present 

3 0 invention comprises a control CPU for outputting a speaker 
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aiuplification value corresponding to volume on a speaker which ia 
adjusted by a terminal user by using a volume control unit, aud ^ 
echo processing unit for reducing an echo equivalent to output voice, 
which is obtained by aicplifying a received input signal deimodulated 
5 and voice-decoded according to the speaker an5)lifi cation value output 
from the control CFU axid outputting the received input signal from 
the speaker and is itdxedwith a transmitting input signal input through 
a microphone, according to the speaker ainplifi cation value . Therefore, 
the echo included in the transmitting voice can be properly reduced 
XO according to the ape^oiker ait^lifi cation value. 
m3 Also, the echo processing unit ccm^rises an echo canceller for 

calculating a pseudo echo f romboth the received input signal atr$jlif ied 
ll according to a degree of the change of the speaker araplif ication value 

IP and filter coefficients calculated according to an acoustic 

15 transmission characteristic between the microphone and the speaker, 
and removing the echo from the transmitting input signal including 
Jj^ the echo by using the pseudo echo. Therefore, a level of an signal 

P input to an adaptive filter, in Which the pseudo echo Is calculated 

frcm the filter coefficients and the anplified received signal^ can 
20 correctly agree with a level of a signal which is amplified according 
to the speaker aiEplif ication value and is output to the outside, and 
the pseudo echo similar to an actual echo can be calculated even though 
the speaker amplification value is changed. Accordingly, the echo can 
be properly removed. 
25 Also, the echo processing unit comprises an echo canceller for 

changing filter coefficients, v^iich are calculated according to an 
acoustic transmission characteristic between the microphone and the 
speaker, according to a degree of the change of the speaker 
an^jlificatlon value, calculating a pseudo echo froiaboth the received 
30 input signal and the filter coefficients, and reimoving the echo froiti 
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the transmit-Uing input signal including "the echo by using t±ie poeudo 
echo- Accordingly, the echo can be properly removed. 

Also, the filter coefficients are changed stage by stage in the echo 
canceller in a case vjbere the degree of tlie cliange of the speaker 
5 amplification value is larger than a prescribed degree of the change. 
Therefore/ ae cootpared with a case where the filter coefficients are 
largely changed at one time, the pseudo echo produced is gradually 
changed, an echo^-canceled signal is gradually changed^ and the 
addition of a djegraded sound can be suppressed. 

10 Also^ the filter coefficients are get to zero or a value near to 
zero in the echo canceller in a case where the degree of the change 
of the speaker aniplification value is larger than a prescribed degree 
of the change , Therefore , the pseudo echo produced is gradually changed, 
an echo-canceled signal is gradually changed, and the addition of a 

15 degraded sound can be suppressed. 

Also, the filter coeff icienta are changed in the echo canceller in 
a case where the degree of the change of the speaker amplification 
value is larger than a prescribed degree of the change within a 
prescribed tiime period- Therefore, in cases lA^ere the speaker 

20 amplification value is moderately changed in a time period so as to 
properly renew the filter coefficients, there is no case where the 
filter coefficients are erroneously changed, and the echo can be 
properly removed. 
Also, the echo ptxjcessing unit conrprises an echo canceller for 

25 calculating a pceudo echo from both the received input signal and the 
filter coefficients calculated according to an acoustic transmission 
characteristic between the micrqphone and the speaker, changing the 
pseudo echo according to the apeaker amplification value/ and removing 
the echo from the transmitting input sigxjial including the echo by using 

30 the changed pseucto echo. Therefore, in a case where a non-linear 
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distortion occurs in a signal input to the echo canceller as an echo 
so as to degrade the precision of tli^ estimation of the filter 
coefficients, or in a case where a considerably large non-linear 
distortion occurs in a signal input to the echo canceller as an echo 
5 so 33 to largely degrade the precision of the estimation of the filter 
coefficients and to add a signal functioning a3 a degraded sotind, the 
case is detected with higher precision, and the degradation of the 
estimation precision of the filter coefficients and the addition of 
a degraded sound can he suppressed . 
10 Also, the pseudo echo is set to zero or a value near to zero in the 
echo canceller in a case where the speaker an^ilification value i3 

Jy larger than a prescribed threshold value. Therefore^ in a case where 

a non-linear distortion occurs in a signal input to the echo canceller 

1)3 as an echo so as to degrade the precision of the estimation of the 

15 filter coefficients , the addition of a degraded sound can be 

, i5 suppressed - 

S - Also, the pseudo echo is attenuated by a prescribed value in the 

O echo canceller in a case vrtiero the speaker artplif ication value is 

larger than a prescribed threshold value. Therefore, in a case where 
20 a non- linear distortion occurs in a 3ignal input to the echo canceller 

as an echo so as to degrade the precision of the estijoation of the 

filter coefficients, the addition of a degraded sound can be 

suppressed. 

Also, the pseudo echo, which is calculated according to the filter 
25 coefficients c:alcula.ted before the Speaker ati$>llfication value 

becoines larger than a prescribed threshold value, is used in the echo 
canceller to remove the echo from the transmitting input signal in 
a case v^ero the speaker ainplif ication value is larger than the 
prescribed threshold value. Therefore, in a case where a nan-linear 
3 0 distortion occurs in a signal input to the echo canceller as an echo 
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SO as to degrade the precision of the estimation of the^ filter 
coefficients^ the addition of a degradctd aoimd can be suppressed. 

Also, the echo processing unit comprises a double talk detecting 
unit for altering a judgment criterion for double talk detection 
5 according to a degree of the change of the speaker airplification value 
and detecting a double talk according to the altered judgment criterion, 
and an echo cancoller for calculating a pseudo echo from filter 
cosfficiienta calculated according to an acoustic transmission 
characteristic between the laicrophone and the speaker, removing the 
10 echo from the transmitting input signal including the echo by using 
the pseudo echo, and performing a renewal stop or a renewal start of 
tU the filter coefficients according to a detection result of the double 

talk detecting unit . Therefore, in a case vrtiere a non-linear distortion 
1!^ occurs in a signal input to the echo canceller as an edho so as to 

^ 15 degrade the precision of the estiiaation of the filter coefficients, 

a 

J J "th^ ^cho removal can be cx>ntinued- 

j^lso, the echo processing unit comprises a double talk detecting 
G unit for altering a judgment criterion for double talk detection 

according to a degree of the change of the speaker amplification value 

2 0 and detecting a double talk according to the altered judgment criterion, 

an echo canceller for reducing an echo coirponent of the transmitting 
input signal by ii3ing a pseudo echo and producing a residual signal, 
and an echo suppressing unit for suppressing the residual signal 
produced in the echo canceller at an attenuation value which changes 
25 according to a detection result of the double talk detecting unit, 
nierefore, even thou^ the speaker amplification value is largely 
changed, the renewal stop of the filter coefficients due to an 
erroneous judgment to be the double talk can be suppressed, and the 
echo can be properly removed. 

3 0 Also, the double talk Is detected by the double talk detecting unit 
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acco^xjLLng to the coa$jarison Of a power of the transmitting iixput signal 
with a power of the residiml signal, and the Judgment criterion for 
double tzLLk detection is altered by the doioble talk detecting unit 
by changing a weighting factor ^ by which the power of the tranaroitting 
5 input signal is multiplied, according to the degree of the change of 
the speaker amplification value. Therefore, even though the speaker 
anrplif ication value ig largely changed so as to enlarge the power of 
tlie residual signal, the renewal stop of the filter coefficients due 
to an erroneous judgment to be the double talk can be suppres-sedr and 

10 the echo can be properly removed. 

Also, the echo processing unit coraprises an echo suppressing xmit 
for suppressing the transmitting Input signal including the echo at 
an attenuation value corresponding to the speaker amplification value 
output frow- the control CPU. Therefore, evien though the echo cannot 

15 be sufficiently reitoved in an echo canceller, a residual echo included 
in the output of echo canceller can be suppre3sed ±n the echo 
suppressing unit according to the speaker amplification value - 

Also, the echo processing unit is formed of a digital signal processor. 
Therefore, the echo can be properly removed, 

2 0 An echo processing processor of the present Invention con^rises a 

received signal input port for receiving a received Input signal 
including voice information, a speaker amplification value input port 
for receiving a speaker amplification value corresponding to volume 
which is adjusted by using a volume control unit, a transmitting signal 
25 Input port for receiving a transmitting input signal including voice 
given by a terminal user, and an echo reduction processing unit for 
performing an echo reduction process in Which an echo equivalent to 
output voice, which is obtained by amplifying the received input signal 
received in the received signal input port according to the speaker 

3 0 anjplif ication value received in the speaker airplif ication value input 
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port and outputting the received inpxit signal from a speaker and is 
mixed with ttie transmitting input signal received in the transmitting 
signal Input port, is reduced according to the speaker aitqplifi cation 
valu©- Therefore, the echo Ijncluded in the transmitting voice signal 
5 can be properly reduced. 

Also, an anQ^lification process for aitplifying the received input 
signal received in the received signal input port according to a degree 
of the change of the speaker amplification value received in the 
:3peaker amplification value input port, a filter coefficient 

10 calculating process for calculating the filter coefficients accoanding 
to son acoustic tran5mi33ion characteristic betweeiti a microphone and 
the speaker, apseudo echo calculating process for calculating a p^eudo 
echo from the filter coefficients calculated in the filter coefficient 
calculating process and the received input signal amplified in the 

15 anqplification process and an echo canceling process for removing the 
echo from the received ir^ut signal by using the pseiodo echo are 
performed In the echo reduction processing unit. Therefore^ the echo 
included in the transmitting voice signal, which is input to an echo 
processing processor through the received signal input port, can be 

20 properly reduced* 

Also, a filter coefficient calculating process for calculating the 
filter coefficients according to an acoustic transmission 
characteristic between a microphone and the speaker, a pseudo echo 
calculating process for changing the filter coef f icieints calculated 

25 in the filter coefficient calculating process according to a degree 
of the change of the speaker amplification value received in the 
speaker anplification value input port and calculating a pseudo echo 
from both the filter coefficients and the received input signal 
received in the received signal input port and an edho canceling 

30 process for removing the echo from the received input signal by using 
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the pseudo echo are performed in the echo reduction processing unit. 
Therefore r proper filter coefficientrt corresponding to the change of 
the spealoer sonpiif ication value cazi be obtcdned, and the echo can be 
properly removed - 

5 Also, the filter coefficients are changed stage Ijy stage in the pseudo 
echo calculating procesa performed in the echo reduction processing 
vinit in a case where the degree of the change of the speaker 
an^lification value is larger than a prescribed degree of the change. 
Therefore, the produced pseudo echo is chaiaged 9tage by stage, end 
10 the occurrence of a degraded sound can be made difficult, 

Al^o, thft filter coefficients are set to zero or a value near to 
ill xero in the pseudo echo calculating process perforitied in the echo 

reduction processing unit in a case where the degree of the change 
Iji of the speaker amplification value is larger than a prescribed degree 

' 15 of the change* Therefore, as oorrpared with a case where the filter 

v:3 coefficients are largely changed by raultiplying the filter 

coefficients by a constant value, the produced pseudo echo is smoothly 
changed, an echo-canceled signal is smoothly changed, and the 
occurrence of a degrade sound can be prevented. 
20 Also, the filter coefficients are changed In the pseudo echo 

calculating process perforraed in the echo reduction processing lanlt 
in a case vabere the degree of the change of the speaker aitplif Ication 
value is larger than a prescribed degree of the change within a 
prescribed time period. Therefore, in cases where the speaker 
25 aiqplif icafcion value is looderately changed in a time period longer than 
the prescribed time period so as to properly renew the filter 
coefficients, the change of the filter coefficients to erroneous 
values can be suppressed^ and the echo can be properly removed* 
Also, a filter coefficient calculating process for calculating the 
30 filter coefficients according to an acoustic transmission 
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cli^act eristic between a Tflicrophone and the speaker, a pseudo <^c3io 
calculating process for calculating apaeudo echo froiaboth the fiiter 
coefficients calculated in the filter coefficient calculating process 
and the received ir^ut signal received in the received signal input 
5 port and an echo canceling process for changing the pseudo echo 
calculated in the pamdo echo calculating process according to the 
speaker emnplif ication value received in the speaker amplification 
value input port and removing the echo frank the received input signeJL 
by using the changed pseudo echo are performed in the echo reduction 

10 processing urd_t. Therefore, in a case where a non-linear distortion 
occurs in a signal input to the echo processing unit as an echo so 
a3 to degrade the precision of the estimation of the filter 
coefficients, or in a case where a considerably large non-linear 
distortion occurs in a signal input to the echo proce39ing xmit a3 

15 an echo so as to largely degrade th^e precisicsia of the estiaiation of 
the filter coefficients and to add a sigrxal functioning as a degraded 
sound, the case can be reliably detected, and the degradation of the 
estimation precisian of the filter coefficients and the addition of 
a degraded sovind can be prevented, 

20 Also, the pseudo echo is calculated according to the filter 

coefficients, which are calculated before the speaker amplification 
value becoiiaes larger than a prescribed tlireshold value, in the paendo 
echo calculating process performed in the echo reduction processing 
unit in a case where the speaker amplification value is larger than 

25 the prescribed threshold value. Therefore, even though a non-linear 
distortion occurs in a signal input to the echo canceller as an echo 
so as to degrade the precision of the estiroation of the filter 
coefficients, the echo removal can be continued. 
AiBOt a double talk detecting process for altering a judgment 

30 criterion for double talk detection according to a degree of the change 
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of the speaker aitplification value ^nd detecting a double ta.lk 
accordiing to the altered judgment criterion,, a filter coefficient 
calculating process for calculating the filter coefficients according 
to an acoustic tranamiaslon characteristic between a microphone and 
5 the speaker and perfoxming a renewal stop or a renewal start of the 
filter coefficients according to a double talk judgment result of the 
double talk detecting procesSf a pseudo echo calculating process for 
calculating a pseudo echo from both the filter coefficients calculated 
in the filter coefficient calculating procese and the received input 

1 0 signal received in the received signal input port and an echo canceling 
process for reraovxng the echo from the received input signal by using 
the pseudo echo are performed in the echo reduction processing unit • 
Therefore, even though the speaker amplification value is largely 
changed/ the renewal stop of the filter coefficients due to an 

15 erroneous judgment to be the double talk can be prevented, and the 
echo can be properly removed. 

Also, a double talk detecting process for altering a judgment 
criterion for double talk detection according to a degree of the change 
of the speaker amplification valuft and detecting a double talk 

2 0 according to the altered judgment criterion, an echo canceling process 
for reducing an echo component of the transmitting input signal by 
using a pseudo echo and producing a residual signal and an echo 
suppressing process for suppressing the residual signal at an 
attenuation value tjhich changes according to a detection result of 

25 the double talk detecting process are performed In the echo reduction 
processing unit- Therefore, an erroneous judgment to be the doiible 
talk can be prevented, and the residual signal can be properly 
suppressed. Accordingly, an echo component sufficiently removed in 
the echo canceling process can be suppressed. 

30 Also, an echo suppressing process for stqpfpressing the trzaneanitting 
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input signal including tb^ echo at an attenuation value correspondJjng 
tc th.e speaker simplification ^ralu^ is perf omcied iti the echo reduction 
processing unit ♦ Therefore, even though an edho caxinot he sufficiently 
removed in the echo canceling process^ a residual echo Included in 
5 a signal, for which the echo canceling process is performed, can be 
suppressed according to the speaker amplification value by performing 
the echo suppressing process. 



ilia 
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nSTDUSTRIAL APPLICABILITY 

As is descxibed above, the voice cararaunication device arid the edho 
processing processor according' to the present i^ivention are 
appropriate for tlxe voice coammmlcation^ for ^xart^jie, performed in 
5 an on- vehicle telephone ox- a portable telephone. 



